ClickHouse Infrastructure Requirements
File Storage Guidelines
File Type Sizing:
- CF files: Consider 50% of original size for ClickHouse storage
- TXT/CSV files: Consider 30% of original size for ClickHouse storage
Pre-Processing Infrastructure
If separate pre-processing is required on top of ALM-generated files:
- Deploy dedicated ClickHouse pre-processing execution server
- Provision exuction server as per existing ALM server configurations
Shared drives
If above is required then the following new shared need to be created:
- SH_CFOPDATA - Operational data storage
- SH_CFLOGS - Logging and audit trail
- SH_CFSETUP - Configuration and setup parameters
Web Server Requirements
If the bank cannot install FTV and Ingestion applications on the existing web server:
- Procure new dedicated web server, OR
- Increase infrastructure capacity of existing ALM web server
Clickhouse Server Capacity Estimates
UAT Environment
| Client Type | Count | RAM (GB) | CPUs |
|---|---|---|---|
| Large | 3 | 128 | 12 |
| Medium | 2 | 96 | 8 |
| Small | 1 | 64 | 8 |
Production Environment
| Client Type | Count | RAM (GB) | CPUs |
|---|---|---|---|
| Large | 4 | 256 | 16 |
| Medium | 3 | 128 | 12 |
| Small | 2 | 64 | 8 |
Summary of Action Items
- Assess current file sizes and calculate storage requirements using the compression ratios above
- Provision pre-processing servers if needed (matching ALM server specifications)
- Create three new database schemas for CFAnalytics
- Evaluate web server capacity and procure additional resources if necessary
- Provision ClickHouse servers according to the capacity table for your environment